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Abstract. 

Fingerprints are commonly used in biometric systems. However, the authentication 
of these systems became an open challenge because fingerprints can easily be fabricated. In 
this paper, a hybrid feature extraction approach named Integration of Probability Weighted 
Spatial Gradient with Ridge Orientation (IPWSGR.) has been proposed for fingerprint 
liveness detection. IPWSGR, integrates intensity variation and local ridge orientation 
information. Intensity variation is computed by using probability-weighted moments (PWM) 
and second order directional derivative filter. Moreover, the ridge orientation is estimated 
using rotation invariant Local Phase Quantization (LPQ") by retaining only the significant 
frequency components. These two feature vectors ate quantized into predefined intervals to 
plot a 2-D histogram. The support vector machine classifier (SVM) is then used to determine 
the validity of fingerprints as either live or spoof. Results are obtained by applying the 
proposed technique on three standard databases of LivDet competition 2011, 2013, and 
2015. Experimental results indicate that the proposed method is able to reduce the average 
classification error rates (ACER) to 5.7, 2.1, and 5.17% on LivDet2011, 2013, and 2015, 
respectively. 

Keywords: PWM, Ridge Orientation, Feature integration, Ridge variation, ridge-valley 
pattern, Higher-order derivative. 


INTRODUCTION 

Biometric authentication is extensively encouraged to be used in security based 
applications for the accurate recognition of the individual on the basis of their unique 
biological traits and hence reduce the vulnerabilities of traditional authentication systems 
e.g., user name and password or secret pin codes, etc [1]. Some of the biological 
characteristics of individuals are defined to be used for recognition and are sub-divided into 
two main classes named as physiological features (fingerprints, iris, hand, and face, etc.), and 
behavioral features (signatures style, and voice, etc.) [2]. However, fingerprint-based 
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authentication is most commonly used in various security applications, most probably due to 
certain distinct properties of fingerprints such as persistence, consistency, and convenience 
[1]. With the rapid advancement in fingerprint-based biometric systems, they are more 
exposed to spoof attacks and can easily be fabricated via spoof materials like gelatin, silicon, 
wood glue, and paraffin, etc. [2]. In order to combat spoofing attacks and to enhance the 
security of user's personal information, fingerprint liveness detection (FLD) is the widely 
used approach to recognize either a sampled image is live or spoof. On the basis of 
characteristics, fingerprint features are categorized into Level 1 (ridge pattern), Level 2 
(minutiae) and Level 3 (sweat pores, edge contours) feature [2]. In recent years, several 
hardware and software-based techniques have been proposed to solve FLD problems [3]. 

Hardware-based approaches require additional components that examine certain life 
signs in fingerprints such as temperature, odor, pulse, conductivity, or blood pressure [1] [2]. 
However, the improper assimilation of sensors can reduce the accuracy of the system. 
Therefore, to get higher performance and competitive solutions for liveness detection, 
software-based approaches are considered as its alternative and gain more interest in 
recognition systems [1]. Alternatively, in software-based approaches different local and 
global feature descriptors have been proposed to solve the FLD problem. An initial study by 
Abhyankar and Schuckers [4] in fingerprint liveness detection was to extract high- 
dimensional features from the inherent multi-resolution texture and local ridge frequencies. 
Liu and Cao [5] proposed a minutiae extraction algorithm from Level 1 features using the 
frequency modulation (FM) model. Despite the fact that Level 3 features are difficult to 
extract, Johnson and Schuckers [6] suggested that observing perspiration phenomena and 
pore location helps in liveness detection. Labati et al. [7] proposed a CNN-based technique 
for extraction and estimation of pore coordinates. However, a pore-based feature extraction 
scheme requires high-resolution fingerprint images. Local Binary Pattern (LBP) [8], Local 
Phase Quantization (LPQ) [9], Weber Local Descriptor (WLD) [10], Local Contrast Phase 
Descriptor(LCPD) [11], and Binary Statistical Image Feature (BSIF) [12], etc., are commonly 
used descriptors for extracting significant textural information. Local Binary Pattern (LBP) 
[8] is a rotational-invariant descriptor that extracts textural features from the grey-level 
image. However, its performance degrades in case of intensity variations and it also contains 
limited information. Therefore, different variants of LBP including LCP (Local coherence 
pattern) [13], LTP (Local ternary pattern) [14], LDP (Local derivative pattern) [15], and 
LTriDP (Local tri-directional patterns) [14] had been proposed in the literature to enhance 
the effectiveness of the LBP. 

Weber Local Descriptor (WLD) proposed by Chen et al. [10] extracts only horizontal 
and vertical information of central pixel and only extracts limited information. Later on, Xia 
et al. proposed [1] an improved descriptor named Weber Local Binary Descriptor (WLBD) 
that mainly overcomes the main limitations related to the orientation and calculation model 
of the original WLD. Gragnaniello et al. [16] combines the contrast and phase information 
using Local Contrast and Phase Descriptor (LCPD). Combined Shepard Magnitude and 
Orientation (SMOc) [17] descriptor combines gradient and orientation information. 
Quantized Fundamental Fingerprint Features (Q-FFF) [18] integrates Level 1 and Level 3 
features effectively. 

Deep learning approaches are also used for the extraction of deep and robust 
features. Sajjad et al. [19] proposed a two-tier approach and used Convolution Neural 
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Network (CNN) for FLD problems. Uliyan et al. [20] used layered architecture models for 
deep learning of detailed features for the recognition of forged fingerprints. Jian et al. [21] 
employed a Densely Connected Convolutional Network and applied a genetic algorithm 
approach to optimize its structure. 

As in PLD, edges contain most of the information and accuracy may be degraded 
due to the elimination of textural or sharp edge details. In existing approaches, different 
smoothing operators such as averaging operators or Gaussian smoothing [17] is used that 
over smoothens the image and suppresses the strong edge information for liveness 
detection. Therefore, for better edge preservation probability-weighted moments PWM was 
successfully used in image deblurring [22], dehazing [23] but never used for fingerprint 
liveness detection. 

The literature study shows that there is a need for a descriptor that extracts 
significant ridge information by minimizing the ACER. In this paper, a feature descriptor 
named Integration of Probability Weighted Spatial Gradient and Ridge Orientation 
(IPWSGR.) has been proposed that integrates the ridge variation and significant ridge 
orientations for liveness detection. 

The rest of paper is organized as follows. Section 2 describes the methodology of 
proposed work (PWSGRo). Experimental analysis is discussed in Section 3 and finally 
Section 4 concludes the work. 


Proposed Methodology 
(IPWSGRo) descriptor extracts information by observing fingerprint image both in 
spatial and frequency domain. Figure 1. Shows the feature extraction mechanism of the 
proposed descriptor. 
And its main steps are discussed in this section. 
1. Ridge variations along vertical and horizontal direction are obtained by the probability 
estimation and second order directional derivatives. 
2. Ro is computed for fingerprint ridge orientation. 
3, Feature set is then obtained by the integration of these two information sets i.e. spatial 
intensity information and local ridge (R.) information. 
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Figure 1. Proposed Descriptor for the extraction of ridge variation and orientation in 
Fingerprint. 

Extraction of Fingerprints Ridge Variation information 

In the proposed methodology, we combined probability-based ridge information and 2” 
order directional derivatives for the computation of local intensity variation in the horizontal 
and vertical direction. Initially, an input image is taken and preprocessed by applying 
Fechner’s law [24]. The logarithmic function in Fechner’s law suppresses the abrupt 
behavior in pixel intensities. This law is mathematically represented as. 


P, =r log(I) (1) 


Considering the perceived intensity of pixel Pjas a 2-D vector, horizontal and vertical 
gradients are computed to extract the better ridge information. In IPWSGR, two different 
gradients along x-y direction are computed. Equation (2)-(3) computes the gradient by using 
the probability weighted moments as it extracts better ridges even in the presence of outliers 
and Equation (4)-(5) calculates the 2™ order gradient. 


gx =PWM,(P;) (2) 
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gy = PWM,(Pi) (3) 
V?gx = Dyx(x,y,0) (4) 
V?gy = Dyy(x,y,0) (5) 


Equation (6)-(7) computes the variations using Shepherd similarity along horizontal 
and vertical directions, respectively. 
Applying exponential transform lowers the intra region variations and resultantly fine edge 
detail is obtained. The magnitude of net variation along x-y directions is then computed 
using Equation (8). 


{x Vay .e "9x! (6) 


i ie Vgy - eI" 7a! (7) 


c= ere 6) 
Ridge orientation Information Ro 

As fingerprint contains non-periodic ridge-valley patterns therefore we need to analyze 
the entire image in the frequency domain. For local orientation estimation of pixels in Ky 
neighborhoods, we use a rotational invariant version of Local Phase Quantization (LPQ"). 
As LPQ* extracts information by dividing the observed image I into ’n’ number of patches 
P,€ {P1, D2) D3........Pn}, each of the size 9x9. For each patch P,, STFT ( 1,,(u) ) is computed 
for each pixel of M points uniformly placed on the circle of radius r. The real and imaginary 
components computed at these frequencies are given by v; = r(sin@; ,cos@;) where 


0, = 21; /u andi = 0,1, 2,..... ,(M — 1). Mathematically formulated as follows: 
1 (a) =) IQ)woy ” 
y 
— xje Jenuy 


For local ridge orientation estimation real and imaginary values of only four 
frequencies oriented at angle 0°, 45° , -45° and 90° degree are considered. Then real and 
imaginary values for each of selected frequencies are computed by means of STFT and 
binary quantized to form 8-bit feature vector 7 = {q1,q2,.--,4g} tepresented as an integer 
value ranging from 0-255 using the following equation. 


Q= Yie1qi2" (10) 


Resultantly, we obtain a feature vector [| F,(Vo),.--+++ F,(vy-1)]. The sign of real 
and imaginary component contains some phase information. From this vector we just retain 
the sign associated with the imaginary part as S; = {SoS1,. ..» , Sm—1} . Characteristic 
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ridge orientation ( Ro) is then calculated using the Equation (11). Similarly characteristic 
orientation of the rotated patch at angle 0 is given by Ro (x) +0 


M-1 (11) 
Rin) = ». sel? 

i=0 

Integration of ridge variation and orientation features 
The final feature vector is obtained by the integration of the ridge variation features and 

local ridge orientation (Rg) features computed in spatial and frequency domain respectively. 
These two feature sets are then quantized for the dimensionality reduction and robust 
recognition. Intensity Variation feature are quantized into V quantization intervals while 
frequency domain features are binned into M levels. Resultantly the dimension of final 
feature vector is 1 X VM. Experimental analysis shows that better results are obtained by 
taking the value of V = 7 and M = 256.The final quantized feature vector obtained over 
the entire image is represented in the form of 2-D histogram. 


RESULTS AND DISCUSSION 

This section at first provides the description of databases used for experimentation and 
the optimal parameter selection is described for the evaluation of IPWSGR.. After that, the 
results of the proposed descriptor along with the chosen parameter are recorded and show 
the accuracies and error rates on each dataset. 


Dataset 

Three standard databases of LivDet competition i.e. LivDet 2011 [25], LivDet 2013 [26] 
and LivDet 2015 [27] are used to assess the performance of our proposed descriptor. 
Different sensors named Biometrika, Digital Persona, Italdata, Swipe, Greenbit, Hi-scan, and 
Sagem are used to capture the fingerprint images. Most of the fake samples in these 
databases are generated by fabricating the live samples using different spoofing material 
along with the support of users that better helps in making the fake samples. All datasets 
contain their independent training and testing sets. Each set has 2000 images belongs to two 
different classes i.e. live and spoof. Training set images are used to train the proposed model 
while performance evaluation of the model is done on the test set. 


Evaluation matrices for Live and Fake error rates 

The performance of IPWSGR,. is evaluated by measuring the accuracy of the 
proposed descriptor and average classification error rate (ACER). Both these parameters Le. 
accuracy and ACER ate mathematically represented in Equation 12 and Equation 13) 
respectively. Let we denote total number of testing images by Nyand correctly classified live 


Nt 
1 

Acc = —) Nj 100 (12 

CC (i i)» (12) 


and fake images as Nj. 


c=1 
ACER is computed by taking average of live and fake error rates as follows: 
LER + FER 
ACER = ——__ (13) 


Feb 2022 | Vol 4| Issue 1 Page | 194 


OPEN ACCESS a r . n 
3 International Journal of Innovations in Science & Technology 


The term live error rate (LER) represents the misclassified live fingerprint images 


and incorrectly taken as fake ones mathematically represented as: 
misclassified live image 
LER = = x 100 (14) 
total number of live images 
Similarly, fake error rate represents the misclassification of spoof fingerprint images 


and incorrectly taken as real or live images mathematically represented as: 


x 100 (12) 


misclassified spoof image 


~ total number of spoof images 


Average classification error rates, live and spoof error rates, and accuracy on LivDet 
2011, 2013, and 2015 are observed individually and recorded in Table 1. However, 
optimized results are obtained by setting the appropriate value of RBF-sigma. It is evident 
from the results reported in Table 1, that the spoof error rate is considerably higher as 
compated to the live error rates in some of the cases. For instance, the significantly higher 
spoof error rate of 14.2% is obtained on Italdata (LivDet 2011). Similarly, considerable 
higher fake error rates of 3.3, 2.1, and 4.1% are obtained on all the datasets of LivDet 2013. 
Likewise, higher spoof error rates of 2.25 and 7.5% are obtained on Greenbit and Hi-Scan 
(LivDet 2013). Like silicone, gelatin makes the perfect copy of a fingerprint, similar to that 
of a real one hence are more difficult to recognize. To evaluate the impact of spoof material 
on error rates, experiments on Biometrika and Italdata (LivDet 2013) have been performed 
and results are presented in Table 2. Five different spoofing materials are used for 
fabricating fingerprints of Biometrika and Italdata (2013) such as EcoFlex, gelatin, 
WoodGlue, latex and Modasil. Obtained results depict that the error rate while using latex” 
material is high for both Biometrika and Italdata and it may affect the overall accuracy. 


Table 1. Average classification error rate, live error rate, and spoof error rate on 
Livedet2011, Livedet2013, and Livdet2015. 


Dataset Ct tm CLT spoof AER Accuracy 
(%) 
Biometrika 3.7 4.6 4.15 95.85 
LivDet Digital Persona 4.7 5.3 5.00 95.00 
ave! Tada 6.5 14.2 10.3 89.65 
Sagem ae 44 3.48 96.52 
Biometrika 0.8 3.3 2.05 97.95 
LivDet Italdata 0.2 21 1.15 98.85 
2013 Swipe 2.1 4.1 3.10 96.9 
Crossmatch 5.33 4.83 5.08 94.92 
LivDet Digital Persona 9.3 6.9 8.10 91.9 
2015 Gteenbit 2.0 2.24 2.12 97.88 
Hi-Scan 3.3 75 5.4 94.6 


Table 2. Live and fake error rates on different spoofing material od Biometrica and Italdata 
of LivDet2013 


Train Set Test Set Biometrika Italdata 
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Live+ EcoFlex Live+ EcoFlex 0.33 0.08 
Live+ Gelatin Live+Gelatin 0.83 1.75 
Live+Latex Live+Latex 3.5 2.0 

Live+ Modasil Live+Modasil 2.33 0.83 
Live+ Woodglue Live+Woodglue 2.75 1.00 


Performance comparison of IPWSGR, with state-of-the-art methods 


In the proposed method IPWSGR, outperforms state-of-the-art methods. Table 3, 
Table 4 and Table 5 shows the performance comparison of LivDet2011, 2013 and 2015 with 
state-of-the-art techniques respectively. 


Table 3. Performance comparison of the proposed descriptor on Livedet2011, with state- 
of-the-art Techniques. 


Methods Biometrika ae Italdata Sagem ACER 
Persona 
WLD [10] 13.3 13,8 21 6.7 15,57 
SMOc [17] 4.9 5.0 i Pal 25 5.87 
WLBD [1] 5:05 4.1 11.85 2,25 5.96 
LCPD [11] 4.9 4.7 123 3.2 6.28 
DCNNISE|28} 9.2 hoe 12.35 2.9 6.45 
CNN [29] 99 1.9 al ta 6.2 
DenseNet[21] Gov one 12.25 5,12 7.76 
Proposed method 4.15 5.0 10.35 3.48 ee 


Table 4. Performance comparison of the proposed descriptor on Livedet2013 with other 


state-of-the-art techniques. 


Methods Biometrika Italdata Swipe ACER 
WLD [10] 5.2 71 8.4 6.90 
SMOc [17] 1.6 1.4 3.8 2.2 
LCPD [11] 1.2 1.3 4,7 2.4 
BSIF [12] 1.1 3.0 5.2 3.1 
CNN [29] 4.6 47.7 6.0 19.4 

DCNNISE [28] 4.35 1.4 2.05 2.6 
DenseNet [21] 2.70 2.00 10.74 54 
PLDNet [21] 2.60 2.15 7.26 4.00 
Proposed Method 205 115 3.10 Av 


Table5. Performance comparison of the proposed descriptor on Livdet2015 with other 
state-of-the-art methods. 


Methods Crossmatch Digital Greenbit Hi- ACER 
Persona Scan 
SMOc [17] 6.40 8.70 2.93 3.15 5.3 
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WLBD [1] 10.82 13.72 4.35 9.64 9.67 
WLD [30] 12.39 15.24 8.69 20.7 14.27 
ROI 31] 3.46 6.8 4.77 6.24 5.32 
ROI+LGP 5.16 8.8 4.93 5.56 6.11 
[31] 
Proposed 5.08 8.10 2.12 5.4 5.17 
Method 


In Table 3 proposed descriptor obtains better accuracy and least error rate of the 
value 4.15% on Biometrika of LivDet 2011. Results reported in Table 4 shows that the error 
rate on the Italdata images is minimized up to 1.15%. This might be because of the usage of 
lower quality spoof samples in Italdata of LivDet 2013. As latent fingerprints are used in the 
spoof creation process, therefore these fingerprints are easily recognizable. It has been 
observed in Table 5, that IPWSGR, increased the accuracy on Crossmatch, Digital Persona, 
and Green-bit as compared to state-of-the-art methods. The classification performance of 
the proposed descriptor degrades on the Hi-Scan images due to the presence of high- 
resolution images. It is worth noticing from Table 3 that IPWSGR, outperformed in many 
state-of-the-art handcrafted feature extraction methods as well as from deep learning 
approaches. 

While using IPWSGR., the ACER reduces to 0.53% from LCPD [11], 0.12% from 
SMOc [17], 9.62% from WLD [10], 0.21% from WLBD [1], 0.7% from DCNNISE [28] in 
the comparison table of LivDet2011. From T, we observe that ACER reduces to 0.3% from 
LCPD [11], 0.1% from SMOc [17], 4.8% from WLD [10], 0.5% from DCNNISE [28], and 
1% from BSIF [12]. Similarly, in Table 5 the proposed descriptor outperformed as 
compated to state-of-the-art methods such as from SMOc [17] by 0.13%, WLD [30] by 
9.1%, and from WLBD [1] by 4.5%. LBP is commonly used to extract small textural details 
and its performance degrades in case of intensity variation. In BSIF [12], random samples are 
selected that resultantly missed the potential information and hence degrades the detection 
accuracy. Significant ridge information may be lost in WLD [10] due to the consideration of 
only horizontal and vertical direction pixels by its orientation component. In current FLD 
techniques including SMOc [17], LCPD [11] and WLBD [1] incorporate both local and 
global features and have achieved the best results with minimal ACER but these methods. In 
SMOc [17], due to the use of a simple gradient function only limited information have been 
extracted resultantly leads to the loss of significant intensity variation information. In the 
proposed method IPWSGR, outperforms these methods. 

The ridge extraction component of IPWSGR, uses 2™ order gradients and PWM that 
incorporates the significant ridge variations that may be neglected in the previous techniques. 
Additionally, Ro component of proposed descriptor extracts significant ridge orientation 
information by using LPQ" and excluding the irrelevant details. Hence, due to the fusion of 
these two significant information sets, computational complexity can be reduced, and better 
minimal error rates are obtained. Techniques that have low ACER are represented in bold. 
Experimental analysis shows that our framework obtains lower average error rates than the 
existing methods. 
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CONCLUSION 

This paper aims to presents a robust feature descriptor for FLD. Proposed 
descriptor uses PWM and higher-order gradient operator for extracting potential ridge 
variation information in the spatial domain and extracts the significant ridge orientation 
information using a rotational invariant LPQ*. Both feature sets are then quantized into 

predefined intervals for dimensionality reduction. Experimental results on the LivDet 2011, 

2013, and 2015 datasets indicate that our proposed descriptor achieves higher accuracy with 

minimal ACER than state-of-the-art descriptors. Therefore, our future work aims to lessen 

the noise without losing the important information. Moreover, in the future deep learning 

approaches and level 2 features (i.c., minutiae points) will also be incorporated to obtain a 

more significant feature set. 
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